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Proposal of a Checking Parameter in the Simulated Annealing 
Method Applied to the Spin Glass Model 

Chiaki Yamaguchi 
Kosugichou 1-359, Kawasaki 211-0063, Japan 

We propose a checking parameter utilizing the breaking of the Jarzynski equality in the 
simulated annealing method using the Monte Carlo method. This parameter is obtained by 
applying the Jarzynski equality, and is convenient to investigate the efficiency of annealing 
schedules. By using this parameter, it is detected that the system is not in local minima of 
the free energy and the system has reached equilibrium or near-equilibrium. For the spin 
glass model, we consider the application to the ±J Ising spin glass model. The application 
to the Gaussian Ising spin glass model is also mentioned. We discuss that the breaking of 
the Jarzynski equality in this study is induced by the system being trapped in local minima 
of the free energy. As an example, we perform a Monte Carlo simulation to the ±J Ising 
spin glass model, and show the efficiency of the use of the present parameter. 

§1. Introduction 

The theoretical studies of spin glasses have been widely doneP'^ The spin glass 
models have the randomness and the frustration. The combination of the randomness 
and the effect of frustration causes various interesting dynamics as well as the static 
properties. For the spin glass model, there is a problem that it is difficult for the 
system to reach equilibrium by using the Monte Carlo method, although the Monte 
Carlo method is known as a powerful method for investigating spin models. This 
study is related to overcoming the problem of not reaching equilibrium. 

We apply the Jarzynski equality to the spin glass model. The Jarzynski equality 
is an equality that connects the work in non-equilibrium and the ratio of the partition 
functions.®'® The work is performed in switching an external parameter of the 
system. The Jarzynski equality is also derived in the Markov process with discrete 
time in Ref.[5|), and it is pointed out in Ref.[5]) that the Metropolis method® based on 
the Markov process with discrete time is a suited example for applying the Jarzynski 
equality. The Metropolis method is a Monte Carlo method, and gives the way of 
state transitions. In this article, we apply the Metropolis method, although other 
Monte Carlo methods which give the way of state transitions are also applicable. 

We propose a checking parameter in the simulated annealing method using the 
Monte Carlo method. The simulated annealing method®'® i s a method for over- 
coming the problem of not reaching equilibrium, and performs gradual temperature 
reduction (annealing). For this method, annealing schedules are important. If an- 
nealing schedules are not appropriate, the system goes in local minima of the free 
energy, and one can not obtain the physical quantities in equilibrium. Therefore, 
when performing the simulated annealing method, one have to choose an appropri- 
ate annealing schedule. If appropriate annealing schedules are chosen, the system 
goes in global minima of the free energy, and one can obtain the physical quantities 
in equilibrium. The states in equilibrium at zero temperature are the ground states, 
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and the ground states are in global minima of the free energy. The present study in- 
cludes the ground-state search, although we do not mention the ground-state search 
below. 

We do not propose a better Monte Carlo method in this article, and do not 
propose a better annealing schedule in this article. We instead propose a checking 
parameter in this article. By using the present-checking parameter, one can detect 
that the system is not in local minima of the free energy and the system has reached 
equilibrium or near-equilibrium. The checking parameter means that, by using this 
parameter, one can check whether annealing schedules are appropriate or not. 

For the spin glass model, we consider the application to the ± J Ising spin glass 
model. In Ref. [T|), a number of studies for the ±J model by computer simulations 
are seen. The present technique is also applicable to the Gaussian Ising spin glass 
model. The application to the Gaussian model is also mentioned in this article. In 
Ref. [2]), a number of analytical studies for the Gaussian model are seen. 

There are previous studies in Refs. l9j).fT0 |) . [TTj) . [T2"|) for investigating the rela- 
tionship between the spin glass model and the Jarzynski equality. We describe the 
difference between this study and the previous studies. We propose a checking pa- 
rameter, and this parameter is convenient to investigate the efficiency of annealing 
schedules. In the previous studies, this parameter is not mentioned, the breaking 
of the Jarzynski equality is not mentioned, and the present model under a uniform 
magnetic field is also not mentioned. 

The meaning of the value of the present-checking parameter is different from 
that of the study of the energy decrease as the temperature decreases, although this 
parameter uses the values of the energies. In the case of the study of the energy 
decrease, one can see that the energy does not decrease for long Monte Carlo time, 
however, one can not determine whether the system is in local minima of the free 
energy or not. On the other hand, by using the present-checking parameter, one 
can determine whether the system is in local minima of the free energy or not, since 
the value of a quantity obtained by the Monte Carlo method and the analytically 
obtained exact value of the quantity are compared. 

This article is organized as follows. A checking parameter in the simulated 
annealing method is explained in <|2j and the breaking of the Jarzynski equality is 
discussed in £}3j The results of the checking parameter by a Monte Carlo simulation 
are given in The concluding remarks of this article are described in 

§2. A Checking Parameter 

We investigate the ±J Ising spin glass model. The Hamiltonian for Ising spin 
glass models, Ti, is given bjff^® 

n = -^2j l , j s i s j -h^2s l , (2-i) 

where (i, j) denotes nearest-neighbor pairs, Si is a state of the spin at site i, Si = ±1, 
and h is a magnetic field. The value of Jij is given with a distribution P(Jij). The 
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distribution P^ J \jij) of Jij for the ±J model is given by^ 1 

P i±J) (Ji,j) = ^Sj. h j + ^8j.^j, (2-2) 

where 5 is the Kronecker delta, J > 0, and J is the strength of the exchange inter- 
action between the spins. 

We explain the Jarzynski equality \y e consider a non-equilibrium process 
of Xt from Ao to A T . A is an externally controlled parameter, and t = 0, 1, 2, . . . , r. 
The initial and final states in equilibrium are assumed, and the states in the process 
from Ao to A T are in non-equilibrium. The Jarzynski equality is equivalently given 

— w _ Z((3,\ 7 ^ 



z(PM' (2 ' 3) 

where W is the work performed in the process from Ao to A r , (3 is the inverse temper- 
ature of the reservoir, (3 = 1/ksT, T is the temperature, and ks is the Boltzmann 
constant. The overbar indicates an ensemble average over all possible paths through 
phase space. Z is the partition function given by Z = YlfSA ex P( — PH)- The left- 
hand side of Eq. (|2-3|) is the non-equilibrium measurements, and the right-hand side 
of Eq. ()2-3p is the equilibrium information. By using Eq. (|2-3p . one can extract the 
equilibrium information from the ensemble of non-equilibrium. W is given byS 

T-l 

W = Y J [E{H,h + i)-E{i t ,\ t )}, (24) 
t=o 

where E(i t , Xt) is the energy in state it under the externally controlled parameter A(. 
The Jarzynski equality for the temperature-change process is considered in Refs.[9]), 
I13p . For the derivation of the Jarzynski equality [Eq. (|2-3p ] in Ref. [S]), the inverse 
temperature f3 and the energy E(i t ,\t) are always a couple. Therefore, (3 t E(it) for 
switching (3 is also held. Here, fit is the inverse temperature with discrete time t, 
and E(it) is the energy in state it with discrete time t. Then, the Jarzynski equality 
for the process of fit from /3o to /3 T is 

e M = -¥nT\ ' ( 2 ' 5 ) 



z(p 



where fj, is a pseudo work given by 



Li = J2(Pt + l-Pt)E(it). (2-6) 
t=o 

Only the values of the energies just before the temperature changes contribute to 
the value of fj,. 

We consider a quantity [e - ^]/?, where []r is the random configuration average 
for exchange interactions. [e _ ^]ij is a quantity for //, [e~^]ij is a quantity for the 
ratio of the partition functions, and [e~^]# is not the free energy difference. When 
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Pq = and /3 T = [3, by applying Eq. (|2-5p to the ±J Ising spin glass model, we 
obtain 



i(±J) ^ J_ V" 

R 2 n b 2-^ 2 N 



= exp{iV B ln[cosh(/3J)] + iV ln[cosh(/?/i)]} , (2-7) 

where iV is the number of sites, and Nb is the number of nearest-neighbor pairs 
in the whole system. More general solutions for [e - ^]# with h = are written in 
RefsJlU p . llip . By using Eq. (|2-7|) . we define the checking parameter D^ J ^ for the 
± J Ising spin glass model as 

L> (±J) = [exp{-/x - N B ln[cosh(/3J)] - iVln[cosh(/3/i)]}] R . (2-8) 

The value of D^ J ^ is estimated by investigating the value of /x in the Monte Carlo 
method. This checking parameter is available on all lattices, since D^ J ^ does not 
depend on lattice shapes although D^ ±J ' depends on Nb and N . D is an exponential 
quantity for (i, and, in the Monte Carlo method, calculation of exponential quantities 
is generally more difficult than that of linear quantities, on the other hand, it is 
expected that D gives a value close to one or close to zero. When D ~ 1, the system 
is not trapped in local minima of the free energy, and the system is in equilibrium 
or near-equilibrium. When D ~ 0, the system is trapped in local minima of the free 
energy, and the system is in non-equilibrium. The discussion for the value of D is 
given in £J3J 

The meaning of the value of this parameter is different from that of the study 
of the energy decrease as the temperature decreases, although fi in this parameter 
uses the values of the energies as shown in Eq. ([2-6p . In the case of the study of the 
energy decrease, one can see that the energy does not decrease for long Monte Carlo 
time, however, one can not determine whether the system is in local minima of the 
free energy or not. On the other hand, by using the present-checking parameter, one 
can determine whether the system is in local minima of the free energy or not, since 
the exact value of [e - ^]^ is analytically obtained, and it is checked that the obtained 
value by the Monte Carlo method is close to the exact value. 

The distribution p( G ) ( Jj j) of Jj for the Gaussian Ising spin glass model is given 

bjB) 

p,c,,J ^S7-(i)' (2 ' 9> 

When /3q = and j3 T = /3, by applying Eq. (|2-5p to the Gaussian model, we obtain 



1 - iwF^ /_ jn ^ j> J - - Ja — * 



= exp{[N B (PJ) 2 /2] + JVln[cosh(0/i)]} . (2-10) 

More general solutions for [e - ^]^ with h = in the Gaussian model are written in 
RefJlip. We define the checking parameter for the Gaussian model as 

£> (G) = [exp{-/i - [N B {PJ) 2 /2] - jVln[cosh(/3/i)]}] fl . (2-11) 
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\x is given in Eq. ()2-6p . The value of is estimated by investigating the value of 
/x in the Monte Carlo method. This checking parameter is available on all lattices. 
When D ~ 1, the system is not trapped in local minima of the free energy, and the 
system is in equilibrium or near-equilibrium. When D ~ 0, the system is trapped in 
local minima of the free energy, and the system is in non-equilibrium. The discussion 
for the value of D is given in £j3j 

§3. The Breaking of the Jarzynski Equality 

Here, we discuss that the breaking of the Jarzynski equality in this study is 
induced by the system being trapped in local minima of the free energy. At first 
the breaking of the Jarzynski equality in this study is discussed, and, secondly, the 
relation between the value of the checking parameter D and the minima of the free 
energy is discussed. 

We mention a part of the derivation of the Jarzynski equality for discussing the 
breaking of the Jarzynski equality. The detail of the derivation is written in Ref. [5|) . 
For convenience' sake, we mention the Jarzynski equality for the temperature-change 
process. The Jarzynski equality for the temperature-change process is considered in 
Refs. IU|). I13|) . In a canonical ensemble, the equilibrium probability of a state it given 
a fixed value of (3 t is 

p(i 'l« - m 

By using the probability of making a transition between two states P{U- 
the detailed balance is given by 

P(i t _i - *>it)P(it-i|ft) = P(i t _! <*_*t)P(*t|ft) . (3-2) 
There is a relation: 

P(i |A))P(io A ti) ■ ■ ■ P(i T -! A i T ) „ Z{p\) 



P(i T \P T )P(i Q ^i 1 )...p{i T _ li E^i T ) Z{Po) 



(3-3) 

By using Eqs. (|2-6p . (|3Tp and (|3-2p . one can confirm that the relation (|3-3p is correct. 
Then, e~^ is given by 

F^= ^olAWoAiij-Plv-iAge-" 

io,ii,...,i T 



P(i T \Pr)P(io A ti) • • • P(v_i A v) e 

io,ii,...,i T 
Z(Pr) 
ZWo) ' 



Z{Po) 

(3-4) 



In order to obtain the Jarzynski equality, P(«o|/3o) and P{i T \f3 T ) are implicitly used. 
P(*o|/3o) an d P(i T \/3 T ) are equilibrium probabilities. If a state transition sequence 
io ii > i T by a Monte Carlo simulation gets the system into a local minimum of 
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the free energy, the resulting P(i T \/3 T ) is not correct, and then the Jarzynski equality 
can be broken. By using the checking parameter which we mention in this article, 
the occurrence of the breaking is checked. 

It is pointed out in Ref.[3]) that the Jarzynski equality [Eq. (j2-3|) ] does not depend 
on both the path from Ao to A T , and the rate at which the parameters are switched 
along the path. However, these properties of the Jarzynski equality for the path and 
the rate can only be held for the system going in global minima of the free energy. 

We discuss the relation between the value of the checking parameter D and the 
minima of the free energy. By using Eq. (|2-6p , the checking parameter is 

D = [e-^ A ] R = [e-EfeoCft+i-AJSfHj-iaAjjj , (3.5) 

where A is the analytical solution of [e~^]#. The part of fy+i — fit is positive, since 
annealing processes are supposed. Prom Eq. f)3-5|) . one can see that the values of the 
energies [E{i$), E(i\), . . . , E(i T -i)] are important for the equality of the Jarzynski 
equality. If the system is in local minima of the free energy, it is expected that 
the energy does not decrease as the temperature decreases. Therefore, the energy 
E^ Loc \it) of the system in local minima of the free energy can be higher than the 
energy E^ Glo \it) of the system in global minima of the free energy. By using the 
energy E( Glo \it), D ~ 1 can be obtained. In other words, it is considered that, if 
the system is in equilibrium or near-equilibrium, the checking parameter D gives a 
value close to one. By using the energy ~ can be obtained. In other 

words, it is considered that, if the breaking of the Jarzynski equality is induced by 
the system being trapped in local minima of the free energy, the checking parameter 
D gives a value close to zero. 

Therefore, we consider that, if D ~ 1, the system is not trapped in local minima 
of the free energy, and the system is in equilibrium or near-equilibrium. We consider 
that, if D ~ 0, the system is trapped in local minima of the free energy, and the 
system is in non-equilibrium. 

§4. The Results of a Monte Carlo Simulation 

As an example of the use of the present-checking parameter, we performed a 
Monte Carlo method to the =t J Ising spin glass model on the cubic lattice with pe- 
riodic boundary conditions. As the Monte Carlo method, we applied the Metropolis 
methodP We set the value of the magnetic field h to zero. We investigated the 
annealing schedule of T = N/t a , where a is an adjusting parameter, and, in this sec- 
tion, t is the Monte Carlo time. We made temperature change per one Monte Carlo 
step according to the annealing schedule of T = N/t a . The spins are random in the 
initial states. We estimated the checking parameter D^ J ^ by calculating the pseudo 
work [i. The linear system-size is 8, the number of sites, N, is 512, and the number of 
nearest-neighbor pairs in the whole system, Nb, is 1536. We investigated a = 1.2, 1.0 
and 0.8. We set J /ks = 1 for simplicity, and investigated T = 1.0, 1.1, 1.2, . . . ,4.8. 

The result for T' by using data from T = 00 to T = T' is obtained. If T' > T" , 
by using a part of data from T = 00 to T = T", one is able to obtain the result 



Proposal of a Checking Parameter in the Simulated Annealing Method 



7 



2 



1.5- 

(+-J) 

1 - 



• a= 1.2 

O a = 1.0 



D 



0.5 








1 



2 



3 
T 



4 



5 



Fig. 1. The relation between the temperature T and the checking parameter D ( '. The results 
of the ± J Ising spin glass model on the cubic lattice are shown. The linear system-size is 8, and 
the annealing schedule is T = N/t a . The solid circle represents the result for a = 1.2, the open 
circle represents the result for a — 1.0, and the solid square represents the result for a = 0.8. 
J/ks = 1 and h = are set. 



for T' . We obtained the results for T = 1.1, 1.2, . . . , 4.8 by using parts of data from 
T = oo to T = 1.0. 

The number of the average for exchange interactions is 1000 for each a. The 
number of the Monte Carlo steps of the single run for a = 1.2 is 181, and the total 
number of the Monte Carlo steps for a = 1.2 is 181 x 10 3 . The number of the Monte 
Carlo steps of the single run for a = 1.0 is 512, and the total number of the Monte 
Carlo steps for a = 1.2 is 512 x 10 3 . The number of the Monte Carlo steps of the 
single run for a = 0.8 is 2435, and the total number of the Monte Carlo steps for 
a = 1.2 is 2435 x 10 3 . 

Fig. [H shows the relation between the temperature T and the checking parameter 
£)(±J) _ The solid circle represents the result for a = 1.2, the open circle represents 
the result for a = 1.0, and the solid square represents the result for a = 0.8. As 
the error bars, the standard errors are shown. The result with a = 1.2 for T > 3.1 
shows D^ J ^ ~ 1. Therefore, from the discussion in £}3l the system with a = 1.2 for 
T > 3.1 is in equilibrium or near-equilibrium. The result with a = 1.0 for T > 2.9 
shows D^ J ' ~ 1. Therefore, from the discussion in Jj3l the system with a = 1.0 for 
T > 2.9 is in equilibrium or near-equilibrium. The result with a = 0.8 for T > 2.0 
shows D^ J ^ ~ 1. Therefore, from the discussion in £}3l the system with a = 0.8 for 
T > 2.0 is in equilibrium or near-equilibrium. The results with a = 1.2, 1.0 and 0.8 
for T < 1.6 show D^ J ^ ~ 0. From the discussion in the systems with a = 1.2, 1.0 
and 0.8 for T < 1.6 are trapped in local minima of the free energy. 
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§5. Concluding Remarks 

We proposed a checking parameter utilizing the breaking of the Jarzynski equal- 
ity in the simulated annealing method using the Monte Carlo method. This param- 
eter is obtained by applying the Jarzynski equality, and is convenient to investigate 
the efficiency of annealing schedules. By using this parameter, it is detected that 
the system is not in local minima of the free energy and the system has reached 
equilibrium or near-equilibrium. For the spin glass model, we considered the appli- 
cation to the ± J Ising spin glass model. The application to the Gaussian Ising spin 
glass model was also mentioned. We discussed that the breaking of the Jarzynski 
equality in this study is induced by the system being trapped in local minima of the 
free energy. As an example, we performed a Monte Carlo simulation to the ± J Ising 
spin glass model, and showed the efficiency of the use of the present parameter. 

The checking parameter in the quantum adiabatic computation^ can also be 
obtained. The Hamiltonian is given by 9 ' % = — <7^{i j) Ji,j a i a j ~ 0- ~ d)^J2-i a ti 
where a\ is the k component of Pauli matrix at site i, g is switched from to 1, 
and this switching of g corresponds to the annealing process in the system, r is 
the strength of the transverse field. The distribution of Jy is in Eq. (|2-2j) . [e~L l ]n 
is analytically obtained as® [e - ^]/? = [cosh.{j3 J)] N B /[cosh((3r)] N . Thus we define 
the checking parameter D^ A ^ for the quantum adiabatic computation as D^ A ^ = 
[ e -fi-ln{[cosHl3J)] N B/lco S Hl3r)]N}} R _ ^ ig given in Eq _ Xhe value of D (QA) ig 

estimated by investigating the value of \i in the Monte Carlo method. This checking 
parameter is available on all lattices. When D ~ 1, the system is not trapped in 
local minima of the free energy, and the system is in equilibrium or near-equilibrium. 
When D ~ 0, the system is trapped in local minima of the free energy, and the system 
is in non-equilibrium. The discussion for the value of D is given in §21 

The checking parameters for investigating other models can also be obtained. In 
order to obtain the checking parameter used in a model, it is necessity that [e~^]j? 
for the model is analytically solved. 
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